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ABSTRACT 

A  robot’s  morphology  affects  not  only  its  capabilities,  but 
also  its  evolvability.  Here  we  introduce  an  evolutionary 
robotics  platform  that  will  enable  us  to  investigate  the  abil¬ 
ity  of  non-roboticists  to  collectively  explore  the  design  space 
of  evolvable  robot  body  plans.  Users  create  robots  in  a  sim¬ 
ulator  using  an  interactive  interface,  then  let  evolution  find 
a  controller  that  enables  efficient  locomotion.  The  user  can 
change  the  morphology  of  the  robot  and  test  the  new  de¬ 
sign  iteratively,  altering  the  design  based  on  the  assessment 
of  the  robot’s  performance  after  a  period  of  evolution  of 
the  controller.  We  investigate  whether  there  is  a  correlation 
between  the  methods  users  choose  to  build  robots  and  the 
evolvability  of  the  robots. 

Categories  and  Subject  Descriptors 

1.2.9  [Computing  Methodologies]:  Artificial  Intelligence — 
Robotics 

General  Terms 

Design,  Experimentation 

Keywords 

Evolutionary  robotics,  User-guided,  Crowd-sourcing 

1.  INTRODUCTION 

It  is  not  clear  what  aspects  of  a  robot’s  morphology  make 
it  evolvable.  Biological  organisms  exhibit  a  wide  variety  of 
successfully  evolved  morphologies  that  we  observe  to  build 
general  intuitions  about  the  relationship  between  morphol¬ 
ogy  and  behavior.  Here  we  introduce  an  evolutionary  robotics 
platform  that  will  enable  us  to  assess  the  ability  of  mem¬ 
bers  of  the  general  public  to  collectively  explore  the  space 
of  evolvable  robot  body  plans. 

User-controlled  simulations  such  as  breve®  and  framsticks® 
are  available  to  the  general  public.  The  Foldit®  online 


Permission  to  make  digital  or  hard  copies  of  all  or  part  of  this  work  for 
personal  or  classroom  use  is  granted  without  fee  provided  that  copies  are 
not  made  or  distributed  for  profit  or  commercial  advantage  and  that  copies 
bear  this  notice  and  the  full  citation  on  the  first  page.  To  copy  otherwise,  to 
republish,  to  post  on  servers  or  to  redistribute  to  lists,  requires  prior  specific 
permission  and/or  a  fee. 

GECCO  2012  Philadelphia,  PA  USA 

Copyright  20XX  ACM  X-XXXXX-XX-X/XX/XX  ...$10.00. 


game  has  been  successful  in  allowing  non-expert  users  to 
contribute  to  the  prediction  of  possible  protein  configura¬ 
tions.  Our  goal  is  to  use  related  methods  to  investigate 
evolvability. 

2.  METHODS 

The  design  environment  uses  the  Open  Dynamics  En¬ 
gine  (ODE)  physics  engine  with  a  graphics  window  and 
keyboard-driven  input  to  allow  users  to  build  a  robot  from 
an  initial  set  of  disconnected  blocks,  cylinders,  and  hinge 
joints.  The  environment  includes  a  light  source  as  a  target, 
and  the  blocks  and  cylinders  incorporate  light  sensors  that 
the  evolutionary  algorithm  can  use  to  measure  fitness. 

We  ran  three  trials  of  the  experiment,  using  undergrad¬ 
uate  students  in  the  Computer  Science  department  at  the 
University  of  Vermont. 

In  the  first  two  trials,  the  subjects  were  students  who 
were  enrolled  in  an  evolutionary  robotics  class.  The  students 
had  used  ODE  for  their  class  work  and  were  familiar  with 
robotics  in  simulation.  These  early  trials  exposed  shortcom¬ 
ings  in  the  user  interface;  no  results  from  them  are  presented 
here. 

In  the  third  trial,  the  subjects  were  students  who  were 
enrolled  in  a  Human-Computer  Interface  class.  With  two  ex¬ 
ceptions,  these  students  had  no  formal  instruction  in  robotics. 
The  exceptions  were  students  who  had  previously  taken  the 
evolutionary  robotics  class. 

The  trial  consisted  of  two  50-minute  sessions:  first,  a  self- 
guided  tutorial  on  how  to  use  the  simulator  interface,  then 
a  session  in  which  the  subjects  were  asked  to  create  a  robot 
that  had  the  best  potential  for  evolving  efficient  locomotion. 
Two  restrictions  were  imposed:  the  robot  had  to  be  “legged”, 
and  the  size  of  the  robot  was  limited  to  disallow  a  huge  robot 
“falling  over”  in  order  to  get  close  to  the  target. 

Users  were  free  to  watch  their  robot  moving  and  to  change 
its  morphology  as  often  as  they  liked  during  the  allotted 
time.  The  simulator  captured  the  time-stamped  command 
keystrokes  from  each  user’s  session  as  well  as  the  simulation 
environment  that  contained  each  user’s  robot. 

3.  RESULTS 

About  half  of  the  students  (nine  total)  produced  a  robot 
that  could  be  simulated,  though  not  all  could  be  analyzed 
as  intended  (see  below). 

We  re-created  the  student  robots,  standardized  the  start¬ 
ing  distance  for  each  robot  from  the  target  in  the  environ¬ 
ment,  and  let  the  robots  evolve  for  24  hours  (wall  clock 


Figure  1:  Robot  fitness  for  nine  sample  robots.  Er¬ 
ror  bars  show  the  standard  deviation  in  fitness  for 
the  thirty  runs. 


time).  For  this  preliminary  trial,  we  performed  thirty  in¬ 
dependent  runs  of  each  student’s  robot,  using  the  ALPS 
algorithm  'l2\  We  took  the  best  robot  from  each  run  and  cal¬ 
culated  the  mean  from  the  thirty  runs  to  produce  an  average 
fitness  value  for  each  robot. 

The  bar  graph  in  Figure  1  shows  the  average  fitness  for 
the  robots  in  this  preliminary  run,  where  fitness  is  defined 
as  the  distance  from  robot  to  target  (smaller  is  better)  at 
the  end  of  the  simulation  time.  Of  the  nine  robots  shown, 
the  rightmost  three  were  excluded  from  further  analysis. 

The  best-performing  robot,  robot  9,  moves  by  rolling, 
which  disqualifies  it.  (The  student  found  a  way  to  make 
it  roll  using  a  hinge  joint.)  The  other  two  unusable  robots 
were  created  with  an  earlier  version  of  the  application, which 
did  not  include  keystroke  capture.  For  this  reason,  we  can¬ 
not  analyze  the  user  inputs  for  these  robots. 

We  are  thus  left  with  six  robots  and  the  command  se¬ 
quences  that  document  their  construction.  We  cannot  draw 
conclusions  from  such  a  small  number  of  datapoints,  but 
scatterplots  showing  fitness  and  statistics  from  command 
keystrokes  are  shown  in  Figure  2  to  illustrate  our  intentions 
for  future  research.  Statistics  include  the  count  of  subjects’ 
use  of  commands,  and  time  metrics. 
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Figure  2:  Selected  user  inputs  vs.  robot  fitness 
(lower  distance  from  target  is  better). 


to  use  their  intuition  and  practical  knowledge  of  mechani¬ 
cal  systems  as  well  as  visual  feedback  from  the  simulator  to 
guide  robot  development. 


4.  DISCUSSION 

The  first  two  trials  using  the  simulation  environment  showed 
that  the  simulator  was  not  robust  enough  for  computer- 
literate  college  students,  much  less  for  the  general  public. 
Subsequent  simulator  improvements  helped,  so  that  the  third 
trial  produced  some  data,  but  too  small  a  percentage  of  users 
produced  a  working  robot. 

The  plots  of  fitness  versus  user  input  statistics  shown  in 
Figure  2  represent  a  first  step  in  analysis  that  could  reveal  a 
correlation  between  fitness  and  user  behavior.  For  example, 
the  mean  time  between  commands  might  be  interpreted  as 
an  indicator  of  the  level  of  interest  of  the  subject. 

Planned  future  work  includes  improvements  to  the  system 
interface,  in  order  to  lighten  the  burden  on  the  user  and  with 
the  ultimate  goal  of  making  the  system  game-like  enough  to 
attract  many  more  users  and  to  see  if  subjects’  intuitions 
about  evolvability  can  be  validated. 

We  hypothesize  that  users  do  not  have  to  be  robotics  ex¬ 
perts  to  collectively  explore  the  space  of  robots  amenable  to 
optimization  by  an  evolutionary  algorithm;  they  may  be  able 
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